首页> 外文OA文献 >A Comparison of Reinforcement Learning Techniques for Fuzzy Cloud Auto-Scaling
【2h】

A Comparison of Reinforcement Learning Techniques for Fuzzy Cloud Auto-Scaling

机译:模糊云强化学习技术的比较   自动缩放

代理获取
本网站仅为用户提供外文OA文献查询和代理获取服务,本网站没有原文。下单后我们将采用程序或人工为您竭诚获取高质量的原文,但由于OA文献来源多样且变更频繁,仍可能出现获取不到、文献不完整或与标题不符等情况,如果获取不到我们将提供退款服务。请知悉。

摘要

A goal of cloud service management is to design self-adaptable auto-scaler toreact to workload fluctuations and changing the resources assigned. The keyproblem is how and when to add/remove resources in order to meet agreedservice-level agreements. Reducing application cost and guaranteeingservice-level agreements (SLAs) are two critical factors of dynamic controllerdesign. In this paper, we compare two dynamic learning strategies based on afuzzy logic system, which learns and modifies fuzzy scaling rules at runtime. Aself-adaptive fuzzy logic controller is combined with two reinforcementlearning (RL) approaches: (i) Fuzzy SARSA learning (FSL) and (ii) FuzzyQ-learning (FQL). As an off-policy approach, Q-learning learns independent ofthe policy currently followed, whereas SARSA as an on-policy alwaysincorporates the actual agent's behavior and leads to faster learning. Bothapproaches are implemented and compared in their advantages and disadvantages,here in the OpenStack cloud platform. We demonstrate that both auto-scalingapproaches can handle various load traffic situations, sudden and periodic, anddelivering resources on demand while reducing operating costs and preventingSLA violations. The experimental results demonstrate that FSL and FQL haveacceptable performance in terms of adjusted number of virtual machine targetedto optimize SLA compliance and response time.
机译:云服务管理的目标是设计自适应的自动缩放器,以对工作负载波动做出反应并更改分配的资源。关键问题是如何以及何时添加/删除资源,以满足已达成协议的服务级别协议。降低应用程序成本并确保服务水平协议(SLA)是动态控制器设计的两个关键因素。在本文中,我们比较了两种基于模糊逻辑系统的动态学习策略,它们在运行时学习和修改模糊缩放规则。自适应模糊逻辑控制器与两种强化学习(RL)方法结合:(i)模糊SARSA学习(FSL)和(ii)FuzzyQ学习(FQL)。作为一种非策略方法,Q学习独立于当前遵循的策略进行学习,而SARSA作为一种基于策略的方法,始终会结合实际代理的行为并导致更快的学习。两种方法都在OpenStack云平台中实现和比较了它们的优缺点。我们证明,这两种自动扩展方法都可以处理各种负载流量情况(突发和周期性),并按需交付资源,同时降低运营成本并防止违反SLA。实验结果表明,FSL和FQL在调整目标虚拟机数量以优化SLA遵从性和响应时间方面具有可接受的性能。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
代理获取

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号